Relevance determination in Learning Vector Quantization
نویسندگان
چکیده
We propose a method to automatically determine the relevance of the input dimensions of a learning vector quantization (LVQ) architecture during training. The method is based on Hebbian learning and introduces weighting factors of the input dimensions which are automatically adapted to the speci c problem. The bene ts are twofold: On the one hand, the incorporation of relevance factors in the LVQ architecture increases the overall performance of the classi cation and adapts the metric to the speci c data used for training. On the other hand, the method induces a pruning algorithm, i.e. an automatic detection of the input dimensions which do not contribute to the overall classi er. Hence we obtain a possibly more eÆcient classi cation and we gain insight to the role of the data dimensions.
منابع مشابه
Relevance Determination for Learning Vector Quantization using the Fisher Criterion Score
Two new feature relevance determination algorithms are proposed for learning vector quantization. The algorithms exploit the positioning of the prototype vectors in the input feature space to estimate Fisher criterion scores for the input dimensions during training. These scores are used to form online estimates of weighting factors for an adaptive metric that accounts for dimensional relevance...
متن کاملRLVQ determination using OWA operators
Relevance Learning Vector Quantization (RLVQ) (introduced in [1]) is a variation of Learning Vector Quantization (LVQ) which allows a heuristic determination of relevance factors for the input dimensions. The method is based on Hebbian learning and defines weighting factors of the input dimensions which are automatically adapted to the specific problem. These relevance factors increase the over...
متن کاملThe Performance of LVQ Based Automatic Relevance Determination Applied to Spontaneous Biosignals
The issue of Automatic Relevance Determination (ARD) has attracted attention over the last decade for the sake of efficiency and accuracy of classifiers, and also to extract knowledge from discriminant functions adapted to a given data set. Based on Learning Vector Quantization (LVQ), we recently proposed an approach to ARD utilizing genetic algorithms. Another approach is the Generalized Relev...
متن کاملThe Mathematics of Divergence Based Online Learning in Vector Quantization
We propose the utilization of divergences in gradient descent learning of supervised and unsupervised vector quantization as an alternative for the squared Euclidean distance. The approach is based on the determination of the Fréchet-derivatives for the divergences, wich can be immediately plugged into the online-learning rules.We provide themathematical foundation of the respective framework. ...
متن کاملComputing OWA weights as relevance factors
* On leave of absence from the Department of Electronics and Computers, Transylvania University of Braşov. Abstract – Ordered Weighted Aggregation (OWA) operators represent a distinct family of aggregation operators and were introduced by Yager in [1]. They compute a weighted sum of a number of criteria that must be satisfied. The central element of the OWA operators is that the criteria are re...
متن کامل